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ANNOTATION 


In this article, the word order and the place of sentence fragments in Uzbek language sentences, determining 
the correct order of sentences, the algorithm of syntactic analysis (parsing) of Uzbek language texts and the 
treebank structure are analyzed. Dependency parsing and Constituency parsing, which are syntactic analysis 
methods, are described. Simple sentence models, POS tagging, and part-of-speech tagging are shown. The 
Context-free grammar calculated by the syntactic parsing algorithm and graphs based on this grammar are 
given. 


KEYWORDS: Word order, parsing, treebank, Subordinate analysis, Cluster analysis, CFG, Noun phrase, 
Verb phrase, Change-based approaches, Graph-based approaches. 


Introduction. Word order — the arrengment of sentence components in accordance with certain grammatical 
tules, syntactic, semantic, stylistic aspects[https://uz.wikipedia.org/wiki/So‘z_tartibi]. 


Starting from the second half of the 20th century, the American linguist Greenberg, based on the study of 
many languages, came to the conclusion that there are six fundamental orders of sentence components, 
including SOV, SVO, VSO, VOS, OVS, OSV, where S is the subject, O is the object and V is the 
VerbDKypuucxaa M. A. 1990, 511-512]. 
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SOV vos 
Murat elmayi yedi— Turkish Tiako ny akondro — Malagasy 
SVO ~*~ — OVS 
Mune upaeamca 6ananoi — Russian Apalai, Hixkaryana 
Vso ——~ \_. osv 
Is maith liom bananai — Irish Warao 


In Uzbek language, sentences are structured based on the SOV order. 


SUBJECT — OBJECT - VERB 


SOV hiitimes;in iim." >  Singlim gullarni juda yaxshi ko ‘radi 


4 5 % word order preference, SOV is 
the most common type 
ee = = = 8 ‘Se » Bahorda atrof yashil tusga kiradi 


> albanian > japanese 

> azerbaijani » kazakh 

eee . korean oe * Onam maktubimni o ‘gibdi 
> basque > kyrgyz 

> bengali > persian 

> chinese > turkish 

> dutch > udu 44. WQiemey............. » Bekzod badiiy asarlar o ‘gishga 
> french > uzbek juda qizigadi 

> hind 

Pete  — = = FF seessneserere >  Uyimiz tog‘ yaqiniga qurilgan 


The word order is a syntactic phenomenon that indicates the arrangement of sentence components in speech. 
In Uzbek language, the word order is mainly free, but it still has a dependent word order. This shows the 
unique characteristic of Uzbek language sentence structure. Some components may come in various places in 
sentence, while others come only in specific positions. When the syntactic position and function of words are 
determined by specific grammatical tools (such as classifiers, prepositions, auxiliary verbs, etc.), the word 
order is free. However, when determining the word order based on its position in a sentence, the word order 
becomes dependent. The word order affects both the syntactic and stylistic functions in the sentences. In 
Uzbek language, word order can serve as one of the grammatical tools that determines the syntactic 
relationship between words. For example: Chaqqon bolalar yugurishdi. In the sentence, the word chaqqon is 
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placed after the word bolalar in the word order. This change in word order affects both the grammatical 
relationship and the meaning: Bolalar chaqqon yugurishdi. As we can see, the word order in such cases serves 
the syntactic function. In cases of balanced sentences (where the first parts of sentences express equal 
concepts), the change in the position of the first part also changes their syntactic function (in this case, no 
building or suffix is used); Toshkent — O ‘zbekistonning poytaxti; O‘zbekistonning poytaxti — Toshkent. The 
change in the position of components in a sentence that contains an identifier and an identified part created a 
two-part sentence with a subject and predicate. Oppog paxtazor! — Paxtazor oppog. These are dependent word 
orders. In free word order, the arrangement of words does not necessarily convey the grammatical state and 
the meaning of the sentences a whole but instead emphasizes the importance of a particular part of the 
sentence, contributing additional information, additional tone and _ stylistic purpose to the general 
idea[Abdurahmonov, Shoabdurahmonov, Hojiyev, 1976: 176]. 


In a sentence, the position of the subject and verb. In Uzbek language, the subject usually comes at the 
beginning of the sentence with its related words, while the verb comes at the end of the sentence with its 
related words. Therefore, the word order of the subject and verb is in the form of “subject+verb”: Gullar 
ochildi. Any related words that come before the main parts of the sentence can be considered as the related 
words of the subject, while any related words that come after the main parts of the sentence can be considered 
as related word of verb: Supada o ‘tirgan onam menga qarab kuldi. In a sentence, the subject usually comes 
before the verb and the verb comes after the subject which is the normal order. Conversely, the inverse order, 
where the verb comes before the subject, is possible as well. Inversion of the subject and verb occur in the 
following cases: 


1. In literarcy language, to enhance the impact and emotionality: Xalglarimiz do ‘stligi mangu yashasin va 
yashnasin! 


2. In a dialogue: Hammani ovora qildi bu shumtakalar («Mushtum»). 


3. In the author's sentence used after the quotation: Bu gog‘ozlar taxminlarga asoslangani uchun hujjat 
bo ‘lolmaydi, — dedi Yagona, uning so ‘zini kesib (1. Rahim). 


29 66 


4. In poetry, as a result of the requirements of “vazn’’, “qofiya” and “turoq”: Keldi bahor, gul bahor, Erib bitdi 
oppog gor (Sh.Sa’dulla) [Abdurahmonov, Shoabdurahmonov, Hojiyev, 1976: 176]. 


The position of the object (in Uzbek: to‘Idiruvchi) in a sentence. The position of the object in a sentence is 
determined in relation to what is being objected. The order of the object and what is being objected is usually 
in the form of “object+what is being objected”. If several objects are attached to one what is being objected, 
the object indicating the object is usually closer to what is being objected. Therefore, an object without any 
indicators is placed before the filler with the indicators in relation to what is being objected: Men sizga 
gadimgi Buxoroning yodgorliklarini ko ‘rsataman. If the object is instrumental, its position is determined with 
respect to the what is being objected and is placed after it: Buni senga oldim. In Uzbek language, the inversion 
of the object and what is being objected is also possible. In this case, the inversion occurs in the function of 
the what is being objected. The conditions for this inversion are similar to the conditions for the inversion of 
the subject and verb, and are related to the emotional, literary and speech requirements that follow the brief 
introduction made by the author: Ko ‘rmayin bosdim tikonni, tortadirman jabrini (Uyg‘un) [Abdurahmonov, 
Shoabdurahmonov, Hojiyev, 1976: 181]. 


The position of the adverb(in Uzbek: Hol) in a sentence. It stands before the “hollanmish’(adverb is the 
dependent of hollanmish). The positions of adverb in the sentence that is dependent of the “hollanmish” are 
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follow: The style represented by the adverb is located close to the “hollanmish”: U eshikdan sevinib kirib 
keldi. Quantity-level adverb stands close to the “hollanmish”:Biz siznikiga ko‘p borganmiz. Time and place 
adverbs come together before “hollanmish”, usually at the beginning of the sentence. In this case, the time 
adverb is used first, and the place adverb is used afterwards. Kecha Kievdan bir o ‘rtog ‘im telefon qildi. Cause 
and purpose adverbs can appear in different places of the sentence before being used: Kasal bo ‘lganim uchun 
ishga vaqtida yetib kela olmadim. This usual correct order may vary as logical emphasis demands. A logical 
accent adverb is close to the “hollanmish’(verb). In this case, incomplete inversion occurs. Application of the 
adverb after the “hollanmish’’(verb) causes a complete inversion. Full inversion is found in lively language, 
emotional speech, constructions with excerpted sentences, poetry: Ayta bersam shuki, bu o‘rtoq... govunga 
piyoz qo‘shib yeganlar azbaroyi o‘rtoqg Nurmatovni kuldirish uchun (A.Qahhor) [Abdurahmonovy, 
Shoabdurahmonov, Hojiyev, 1976: 182]. 


The position of the adjective (in Uzbek: Aniqlovchi) in a sentence. In the Uzbek language, the usual, 
correct order of “aniqlanmish” (adjective is dependent of aniqlanmish) with a adjective is in the form 
“adjective + aniqlanmish”. This order is fixed for qualifying with an adjective, and can be changed when 
viewed with an object, and sometimes interpreted with an explicative. An adjective with an “aniqlanmish’’is in 
the correct order in prosaic speech, but in poetic speech it is sometimes inverted: Ona sevmas farzand 
topilmas, Farzand yo ‘qdir onani sevmas (H.Olimjon). We have already said that the transformation of the 
adjective-“aniqlanmish” type of connection into the noun-verb type is not considered inversion. Bayrog, 
havorang, mag ‘rur hilpirab turar (H.G‘ulom) even in constructions of the type, the change of the order of the 
adjective and “aniqlanmish” cannot be considered as an inversion event. Because in inversion, the 
grammatical and semantic relations of the parts of the compound, their functions in the sentence should not 
change. Havorang bayroq mag‘rur hilpirab turar gapida havorang bayrog if the combination comes into 
contact by association and forms an attributive relationship, Bayrog, havorang, mag ‘rur hilpirab turar in the 
sentence, it forms a semi-predicative relationship by entering into communication through interpretation. In 
the next case havorang word is considered a part of a complex sentence construction - a separate part. The 
usual correct order of reference with a referent is the form "referent-relative": mening ukam. This order can 
change depending on emotion in live speech, and depending on things like weight, rhyme, and stop in poetic 
speech, resulting in focus and subject inversion: So‘zi qursin o‘shaning (Uyg‘un) [Abdurahmonov, 
Shoabdurahmonov, Hojiyev, 1976: 183]. 


Syntactic analysis methods. 


Syntactic parsing is the automatic analysis of syntactic structure of natural language, especially syntactic 
relations (in dependency grammar) and labelling spans of constituents (in constituency grammar) [Jurafsky, 
Dan, Martin, James, 2000: 927]. It is motivated by the problem of structural ambiguity in natural language: a 
sentence can be assigned multiple grammatical parses, so some kind of knowledge beyond computational 
grammar rules are need to tell which parse is intended. Syntactic parsing is one of the important tasks 
in computational linguistics and natural language processing, and has been a subject of research since the mid- 
20th century with the advent of computers [https://en.wikipedia.org]. 


Syntactic parsing is generally organized in two main parsing methods: 
1. Dependency Parsing 
2. Phrase Structure Parsing [Unkar, 2007: 154] 
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Dependency Parsing is the task of finding the grammatical structure of a sentence by identifying the syntactic 
and semantic relationships between words [Tunch, 2020: 1]. Dependency parsing has been utilized in many 
other NLP tasks such as machine translation, relation extraction, named entity recognition [14, 15], 
information extraction, all of which involve natural language understanding to an extent. Each dependency 
relation is identified between a head word and a dependent word that modifies the head word in a sentence. 
Although such relations are considered as syntactic, they are naturally built upon semantic relationships 
between words. For example, each dependent has a role of modifying its head word, which is a result of a 
completely semantic influence. An example dependency graph for the sentence: Men yaqin do ‘stimni ko ‘rdim. 


Root 


f ~ 


Men yaqin do‘stimni ko‘rdim 


Syntactic relations between words are generally figured out with an arrow in a dependency tree, which 
connects each head word to a dependent. In other words, in a relation such as Men — ko‘rdim; ”ko‘rdim 
becomes the head and *men” becomes the dependent and the arrow between them states a dependency 
between the two words. The ROOT token represents the root of the dependency tree (i.e. the starting point of 
dependency parsing or the head of the complete sentence). Even if the rules of dependency parsing will be 
discussed later, it is good to state here that every sentence must contain a ROOT token in its dependency tree. 
Dependency parsing is a task that finds the lexical dependencies between words in a sentence, and thereby 
extracts the grammatical structure of a sentence. There are two main approaches applied to dependency 
parsing problem in the literature: 


1. Transition-based. 
2. Graph-based. [Tunch, 2020: 30]. 


Transition-based approaches are generally based on transition commands and a two-stack structure that 
contains a dependency stack and a word buffer. Word buffer contains the words in a sentence. Words are 
drawn from the word buffer and pushed into the dependency stack. If there is a transition between the top two 
words of the dependency stack, then a dependency is created between them and this operation continues until 
there are no words in the dependency stack. The last word in the dependency stack would be the ROOT, 
which isthe root of the dependency tree; starting point of the whole dependency parsing process. [Tunch, 
2020: 6]. 


Graph-based approaches are generally based on performing the entire parsing process as graph operations 
where the nodes in the graph represent the words in a sentence. For the 6 sentence, ’John saw Mary”, imagine 
a weighted graph G with four vertices where each of them refers to a word including the ROOT. Edges store 
the dependency scores between the words. 
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Graph-based Dependency Parsing [Tunch, 2020: 7] 
Related Work on Dependency Parsing 


Eryigit va Oflazer [Eryigit, Oflazer, 2006] come with the idea of using inflectional groups (IGs) for 
dependency parsing. In their study, the authors use a statistical parser that firstly computes unit-unit relations 
where the units are words or IGs and then finds the maximum spanning tree from these computed relations. 
They have three baseline models: Word-based, IG-Based, and IG-Based with word-final IG contexts which is 
an IG-Based model with strictoutputs. As expected, IG-Based models give the best results[Tunch, 2020: 18]. 


Eryigit, Oflazer and Nivre [Eryigit, Nivre, Oflazer, 2008: 357-389] show that the morphological structure 
plays a crucial role in Turkish dependency parsing. The authors show that parsing a sentence considering the 
IGs, which are sublexical units of a word, outperforms dependency parsing based on word tokens of 
sentences. 


Subj 


Loc Adj 


t okul+d F nt ui! on +f 

okul+da ! akil} | th +) +st! ur +); tan: 

Necsretes uv! aI hosed | ea 

bu okul | éfrenci en akil | Sura dur | kiigdk = kz 

+Det +Noun * +Adj *Noun +Adv +Noun/+Adj +Noun *Noun = +Verb'+Adj +Adj +Noun! *Verb 
+*A3sg | +A3pl +A3sg fr With|+Zero *A3sg = + Pos _ | +Prespart +A3sg | +Zero 
+Pnon | +Pnon *Pnon jrA 3sg *Pnon | +Pnon *Pres 
+Loc +Gen +Nom +P3sg *Loc *Nom '+Cop 

I I l+Nom I 1 +A3sg 
This school-at+that-is student-s-" most intelligencet+with+of there standting —Intle girl+is 


The most intelligent of the students in this school is the little girl standing there 


Inflection Groups (IGs) used in dependency parsing [Eryigit, Nivre, Oflazer, 2008: 357-389] 


Oflazer [Oflazer, 2014: 639-653] analyzes different NLP tasks on Turkish. In the dependency parsing task, 
the author underlines the importance of IGs and morphological units in dependency parsing[Tunch, 2020: 19]. 
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Eryigit [Eryigit, 2012: 1960-1965] makes an analysis on parsing in raw datasets in Turkish and shows that the 
locations of words in a sentence plays a crucial role in parsing[Tunch, 2020: 19]. 


Constituency parsing 


The constituency parse tree is based on the formalism of context-free grammars. In this type of tree, the 
sentence is divided into constituents, that is, sub-phrases that belong to a specific category in the grammar. 
[www.baeldung.com]. In Eglish, for example “giziqarli kitob”, “chiroyli kiyingan qiz” and “ajoyib kun 
botishi” are all noun phrases (NP), “pitsa yemoq” and “sohilga bormoq” are verb phrases (VP). The grammar 
provides a specification of how to build valid sentences, using a set of rules. As an example, the rule means 
that we can form a verb phrase (VP) using a verb (V) and then a noun phrase (NP). While we can use these 
rules to generate valid sentences, we can also apply them the other way around, in order to extract the 
syntactical structure of a given sentence according to the grammar. Let’s dive straight into an example of a 
constituency parse tree for the simple sentence, “Men tulkini ko‘rdim” degan oddiy gap uchun guruhlarga 
ajratib tahlil qilish daraxtiga to‘g‘ridan-to‘g‘ri misol keltiraylik [www.baeldung.com]: 


Constituency parsing tree for simple sentence in Uzbek 


Constituency Parsing and Dependency parsing [www.geeksforgeeks.org] 


Constituency parsing focuses on identifying the | Dependency parsing focuses on _ identifying the 
constituent structure of a sentence, such as noun | grammatical relationships between words in a sentence, 
phrases and verb phrases. such as subject-verb relationships. 


Constituency parsing uses phrase structure | Dependency parsing uses dependency grammar, which 
grammar, such as context-free grammar or | represents the relationships between words as labeled 
dependency grammar. directed arcs. 


Constituency parsing is based on a top-down | Dependency parsing is based on a bottom-up approach, 
approach, where the parse tree is built from the | where the parse tree is built from the leaves up to the 
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root node down to the leaves. 


root. 


Constituency parsing represents a sentence as a 
tree structure with non-overlapping constituents. 


Dependency parsing represents a sentence as a directed 
graph, where words are represented as nodes and 
grammatical relationships are represented as edges. 


Constituency parsing is more suitable for natural 
language understanding tasks. 


Dependency parsing is more suitable for natural language 
generation tasks and dependency-based machine learning 
models. 


Constituency parsing is more expressive and 
captures more syntactic information, but can be 
more complex to compute and interpret. 


Dependency parsing is simpler and more efficient, but 
may not capture as much syntactic information as 
constituency parsing. 


Constituency parsing is more appropriate for 
languages with rich morphology such as 
agglutinative languages. 


Dependency parsing is more appropriate for languages 
with less morphological inflection like English and 
Chinese. 


Constituency parsing is used for more traditional 
NLP tasks like Named Entity Recognition, Text 
classification, and Sentiment analysis. 


Dependency parsing is used for more advanced NLP 
tasks like Machine Translation, Language Modeling, and 
Text summarization. 


Constituency parsing is more suitable for 
languages with rich syntactic structures. 


Dependency parsing is more suitable for languages with 
less complex syntactic structures. 


Syntactic Parsing algorithms 


Above, It is given that there are 2 main Parsing types: 


1. Constituency parsing 


2. Dependency parsing 


Below is the algorithm of these 2 different parsing methods: 


Constituency parsing 

a) CKY (Cocke-Kasami- Younger) algorithm 
b) Transition-based 

c) Sequence-to-sequence 

Dependency parsing 

a) Transition-based 

b) Grammar-based 

c) Graph-based 


In computer science, the Cocke-Younger—Kasami algorithm (alternatively called CYK, or CKY) is 
a parsing algorithm for context-free grammars published by Itiroo Sakai in 1961. [Sakai, Itiroo, 1961: 593-— 
608]. The algorithm is named after some of its rediscoverers: John Cocke, Daniel Younger, Tadao Kasami, 
and Jacob T. Schwartz. It employs bottom-up parsing and dynamic programming. [en.wikipedia.org]. 
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The standard version of CYK operates only on context-free grammars given in Chomsky normal form (CNF). 
However any context-free grammar may be algorithmically transformed into a CNF grammar expressing the 
same language [Sipser, Michael, 1997: 99]. 


Context free Chomsky grammar (CFG) is the most widely used formal system for modeling constituent 
structure in natural languages. CFG consists of a set of rules or productions, each of which expresses the ways 
that symbols of the language can be grouped and ordered together, and a lexicon of words and symbols. CFG 
G is defined by four parameters: 


G=<Ns, S, Ts, R>, 
Where Ns — a set of nonterminal symbols; 
S € N —astart nonterminal symbol; 


Ts —a set of terminal symbols; R — a set of rules of the form A — a, A € N —a nonterminal symbol, a € (Ns 
U Ts,) * —a string of of symbols from the infinite set of strings (Ns U Ts,)* [Chomsky, 2002]. 


A CFG is a type of formal grammar that describes a language as a set of production rules that generate all 
possible combinations of syntax structures. These structures can then be used to model sentences and their 
associated meanings. 


In natural language processing, CFG is used to create parsers (Parsers) that can accurately analyze and 
understand sentence structures. By specifying a set of word order rules, CFG helps identify the different parts 
of speech, phrases, and clauses contained in a sentence. 


For example, the CFG rule "S -> NP VP" can be interpreted as "sentence - (S) consists of a noun phrase - 
(NP) followed by a verb phrase - (VP)". In general, CFG grammar is an important tool for sentence modeling 
and natural language processing because it can provide a framework for describing and understanding 
complex natural language structures. 


Eshref Adali and Ikknur D6nmez, in their study the most appropriate formal grammar representing Turkish 
language is investigated. Accuracy of the suggested grammars’ rules is evaluated in two different corpus. This 
study is the enhanced version of “Turkish Context Free Grammar Rules with Case Suffix and Phrase 
Relation” that was presented on UBMK 2016 International Conference on Computer Science & Engineering 
[Dénmez, Adal, 2017: 33-40]. 


Altynbek Sharipbay, Banu Yergesh, Bibigul Razakhova, Gaziza Yelibaye and Assel Mukanova proposes a 
syntactic analysis of Kazakh simple sentences taking into account their semantics. To do this, first, the 
syntactic rules of sentences are described using formal grammar, then parsing trees and ontological models are 
built to determine the semantics of their components and the relationships between them. As a formal 
grammar used Chomsky’s context-free grammar, and ontological models were built in the environment of 
Protége. [Sharipbay, Mukanova, Yergesh, Razakhova, Yelibayeva, 2019]. 


In this research work, to create a syntactic parsing model for simple sentences in the Uzbek language, first of 
all, models for all combinations of simple sentences are developed. Then, based on the developed simple 
sentence models, Context-free grammar is used, and formal grammar rules for simple sentences that can be 
understood by computer programs are drawn up. 
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: POS tegging in ; The syntactic model 
No | Simple sentences Ube POS tegging Gry ie seteace 

: , E+K 

1 Poyezd keldi N+VB _ di N+V 

2 | Kitobnio‘gidi | N_nitVB_di N+V va 

3 | Dalaga boryapman each ra N+V ae 

4 Men taqdimga P+N_ga+VB_di PRON+N +V E+H+K 

kechikdim m 
5 Ali nye Kitobini N+N+N: +ni+VB N4N4N+V E+A+T+K 
oO qlyapti _yapti 
6 NO SG 1 NaN ney di N+N+V Sa 
kuyladi 
7 _ bu yomon — N+P+4JJ +N_nit+ N+PRON+ADIJ4N+V E+A+A+T+K 
qo‘shiqni kuyladi VB_di 
8 Anna kecha N+RR+N_li+V N+ADV4N+V E+H+K 
omadli edi B 
Oq bulutlar bilan JJ+N_lar+0+V . 
? qoplangan B_n_gan map Y A+T+K 
Sabrina kecha : 
10 to‘pni dribling ee N+ADV+N+N+V pare 
qildi +VB_di 


Our next task is to make the simple sentence models compiled in the above table into a formal grammar in 
Context-free grammar. Noun phrase comes in the form of -NP and Verb phrase - VP. 


Sentence: Poyezd keldi 
CFG: S—> NP VP 
VP->V_di 

NP-—>N 

N—>Poyezd 

V_di—>keldi 

Sentence: Dalaga boryapman 
CFG: S—>VP 

VP—> N_ga V_yap_man 
N_ga—>Dalaga 


V_yap_man—>boryapman 
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Sentence: Kitobni o‘qidi 
CFG: S—>VP 
VP->N_ni V_di 
N_ni—>Kitobni 
V_di—o‘qidi 


Based on the CFG grammar, an algorithm for the correct order of simple sentences is created. 


Conclusion 


The complexity of sentence construction in Uzbek creates problematic situations in the process of automatic 
syntactic analysis. Studying the order of occurrence of fragments in sentences, identifying exceptional cases 
and developing a model of sentences based on this, first of all, developing an algorithm for the correct order of 
simple sentences will serve the construction of a syntactic analyzer of the Uzbek language in the future, 
developing parser and treebank programs. has a significant effect on output. 
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